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In this paper, we investigate systematically the Mott-insulator-Superfluid quantum phase transi- 
tions for ultracold scalar bosons in triangular, hexagonal, as well as Kagome optical lattices. With 
the help of field-theoretical effective potential, by treating the hopping term in Bose-Hubbard model 
as perturbation, we calculate the phase boundaries analytically for different integer filling factors. 
Our analytical results are in good agreement with recent numerical results. 
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I. INTRODUCTION 

The physics of dilute ultracold quantum gases in optical lattices has grown to one of the most fascinating fields 
over the last decade [H-ll]- In the case of bosons, the delicate balance between the atom-atom on-site interaction and 
the hopping amplitude leads to a quantum phase transition ^4^ between two distinct phases 5j-tZi]- When the on-site 
interaction is small compared to the hopping amplitude, the ground state is superfluid, as the bosons are phase 
coherent and delocalized. In the opposite limit of the strong on-site repulsion, the ground state is a Mott-insulator, as 
every boson is trapped in one of the potential minima. Meanwhile, this clean defectless setup, which allows for precise 
control of its paramters, has opened up testing ground for quantum many-body physics, i.e. the so-called quantum 
simulation i^. 

While most experiments with ultracold atoms up to date have been performed in simple cubic lattices due to the ease 
of their experimental implementation 8] , recent work have explored ultra-cold atoms in non-standard optical lattices 
such as triangular [91 and hexagonal optical lattices [T^], even the Kagome optical lattices has also been recognized 
couple of months ago [ll|. In fact, due to the complex of the lattice structure in these systems, novel and rich new 
phases will be exhibited. Hence, to determine the quantum phase diagrams analytically in these systems becomed a 
major problem and need to be investigated systematically. 

Actually, there are two main analytical methods which can be used to determine the phase boundaries of Bose gases. 
One is the mean- field theor y [Sj , the other one is the so-called strong-coupling expansion (121] . However, comparison 
with the Monte Carlo data [l3| shows that the mean-field theory underestimates the location of the phase boundary 
while the strong-coupling expansion goes in the opposite direction. More recently, an alternative analytical treatment 
based on the effective potential and Rayleigh-Schrodinger perturbation theory has been presented [l3l, this novel 
method may, in principle, yields analytical results for phase boundaries at arbitrary dimension and lobe number in 
arbitrarily high order accuracy. 

In this paper, with the help of this novel systematic approach, we are going to determine the Mott-Insulator- 
Superfluid (MI-SF) quantum phase boundaries of ultracold scalar Bose systems in triangular lattice, hexagonal lattice 
and Kagome lattice analytically, and present the corresponding expressions of the phase boundaries. Comparing to 
numerical solutions, the relative deviation of our third-order analytical results is less than 10%. 

II. THE MODEL AND THE EFFECTIVE POTENTIAL METHOD 

A system of spinless bosons trapped in a homogeneous optical lattice can be described by the simple yet nontrivial 
Bose-Hubbard Hamiltonian [l|, [l^ which reads 

Hbr = X! "J":* + X! ^^i^^i - 1) - Mi (1) 
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with t being nearest neighbor hopping parameter while U denoting the strength of on-site repulsion between two 
atoms, fii = dlai are the corresponding particle number operator, is the chemical potential. When the depth of the 
optical lattice wells is increased, the hopping parameter t decreases exponentially while U increases linearly [l6| . 

In order to investigate the superfluid-Mott insulator phase transition systematically and to determine the corre- 
sponding phase boundary analytically in a more accurate way, we are going to tackle this issue via field theory, or 
namely, the effective potential method To this end, we add for the moment additional source terms with strength 
J and J* into the Bose-Hubbard Hamiltonian as following 

HBHiJ*, J) = -i 51 + + + Ho, (2) 

and treat the hopping term and external source terms as perturbations. Here 

-ff = X! ^^>-i^i ~ 1) ~ (3) 

i 

is the unperturbed part of the Hamiltonian. 

It is quite straightforward that the grand-canonical free energy can be presented as power series of both the hopping 
parameter t and the source J, J* via Taylor's expansions. Since the unperturbed ground states are Mott states with 
the same occupation number on each site, i.e. the unperturbed state is local, J and J* can only appear in pair in the 
expansion. After regrouping the terms in the free energy with respect of J and J* , the free energy reads 

F(J*, J, t) = (^Fo{t) +f^^C2p{t) I J j , (4) 



with the expansion coefficients 



c2pW-E(-i)"4;' (5) 



n=0 

being power series of hopping parameter t, Ns is the total number of lattice sites. 

The superfluid order parameter tp — {ai) and its complex conjugate can then be calculated by (itI. [isj 

1 dFjr, J, t) 1 dF{j\ J, t) 

^ = n: dj* ' ^ =n: — dj — ■ 

With the help of the above formula, a Legendre transformation of the grand-canonical free energy can thus be 
conducted, leading to the effective potential as follows: 

r(v^, V*) = |^-^v-VJ*. (7) 

Substituting Eq.Q into Eq.®, the relation between the order parameter and the external source strength is obtained 
and can then be used to eliminate J and J* in Eq. ([7]), giving 

r = ^^oW~^IV^P+^|^|^ +.... (8) 

Apparently the effective potential takes exactly the form of (j)^ theory. Indeed, from Eq.Q, it is immediately 
recognized that the external sources can be expressed as 

dn^, r) _ _ J gr(^, r) _ _ „ 

Recalling that the original physical system what we are interested in is a system with vanishing external sources, this 
equation shows that the physical states correspond to the saddle points of the effective potential. As is known, in (j)'^ 
theory the phase transitions is marked by the sign change of the coefficient of the quadratic term, indicating that for 
our system the phase boundary can be found by letting ^^^^ = 0, the solution of this equation will provide us the 
critical value of t. 
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Actually, as shown in Eq.©, C2{t) is a power series of t, thus the radius of convergence of C2{t) will reveal the 
location of the phase boundary. Accordingly, the n-th order approximation of the phase boundary is given by 

(n-l) 

4"' = (10) 

This equation shows that, in principle, the phase boundary of the Bose-Hubbard system can be calculated out 
analytically with arbitrarily high accuracy via the field theory method or effective potential method. It should be 
pointed out that in the pioneer work [l4| in this field, the expression of the phase boundary is different from what we 
got above. The reason is that in that work, was inconveniently expanded to a power series of t. However, this 
inconvenience would not affect the credit of that elegant work. 



III. ARROW-LINE DIAGRAM REPRESENTATION 



From the above discussion, we have translated the problem of finding the phase boundary to the problem of 
calculating the coefficient ctj"^ . These quantities can be calculated via linked cluster expansion 19] and Rayleigh- 
Schrodinger perturbation theory, or namely the Kato's formulation \2d\. 

Since the unperturbed state corresponding to the unperturbed Hamiltonian Hq is Mott state with all lattice sites 
occupied by the same number of bosons, thus, according to Eq. in the free energy F{J*, J,t) (|3]), between the bra 
and ket of the unperturbed ground state, every non-zero contribution to a^"^ includes exactly one creation operator 
at i-th site (associated with Ji) and one annihilation operator at j-th site (associated with J*) as well as n nearest 
neighboring hopping processes (associated with t) connecting i and j sites via other neighboring lattice sites, i-th and 
j-th sites could be the same. 



TABLE I: Diagrammatic expressions of Qj"' for triangular lattice, hexagonal lattice and Kagome lattice 



triangular lattice 



hexagonal lattice 



kagome lattice 



+ 30- 











-^12- 



+30- 




12- 



il.Jl 



32- 



+ 12- 



L..1 



+3- 



+4- 



SI 



When denoting a creation operator on a site by an arrow line pointing in this site and an annihilation operator by 
an arrow line pointing out of this site, each contribution of aj""* can be sketched as an arrow-line diagram composed of 
n oriented internal lines connecting the vertices and two external arrow lines, the vertices in the diagram correspond 
to respective lattice sites, oriented internal lines stand for the hopping process between sites, the two external arrow 
lines are directed into and out of a lattice site, respectively, representing creation and annihilation operators associated 
with the external sources. Each vertex in a diagram must has equal number of pointing-in lines and pointing-out lines. 
Actually, the diagrams are embedded in the lattices and, therefore, their topologies are determined by the topologies 
of underlying lattices. Table H] presents all diagrams as well as the associated prefactors for the first four orders of 
ttg"' in triangular, hexagonal, and Kagome lattices. 

In order to determine the MI-SF quantum phase transitions of scalar Bose system in these non-rectangular lattices, 

the corresponding 03"^ in Table I need to be calculated explicitly, namely, these arrow-line diagrams should be 
translated to proper perturbation formulae. 
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IV. LINE-DOT DIAGRAMS OF PERTURBATION CALCULATION 



Actually, perturbation calculation can be endowed with a line-dot diagrammatic representation [14] which can be 

used to simplify the calculation of above mentioned 0^2^ diagrams. In order to make the paper self-contained, let us 
here give a brief review of this graphic representation of the perturbation theory, for detail technique please refer to 
Ref.[il. 

Suppose the total Hamiltonian is _ff = iJg + gV in which is a perturbation with small parameter g. In general, 
the eigenenergy of the Hamiltonian H is En — YITLq g^E^i^ , where 



V 



(11) 



with 



(0) 
m 


V 




p(0) 

— 


p(o) 



wher 



,(o)\ 



,(0) 



vp(o)|^(j-i) 

^ m \^ n 
p(0) _ 77.(0) 



'^n' j is the n-th cigenstate of unperturbed part Hq while En is the corresponding eigenenergy. These 

complicated forumulae have a simple brief graphic representation. The detailed expression of En^ in Eq. ljlip can 
be represented as a combination of dots and lines by making use of the following rules: (1) each dot represents an 



interaction V] (2) p internal lines connecting two adjacent dots stand for 'Ylimi^T. 



and 



,(o)\ 



(^£;W_^(0)y 



(3)(* 



,(0) 



^'ri j can only be denoted by the left-external and right-external lines, respectively. From the third rule, it is 

easy to recognize that in the diagrammatic representation of E)i there are some graphs which consist of disconnected 
parts, the sign in front of this type of graphs is (—1)'* ^ , where s is the number of the disconnected parts in this 
graph. 

To illustrate these rules more clearly, as an example, let us concentrate on e'^^ . From Eq. ([TT|). it reads 



= E E 

7ni^n 7712 T^n 



V 



(0) 



(0) 



(0) 



V 



then, by utilizing the rules mentioned above, we have 



■ E {^^' 



E 



V- 



(0) 



V 



^(o)\ /^(o) 



c;(0) _ p;(0) 



V 



• • m 



(12) 



This procedure can be extended to cases with several perturbation terms [14]. However, in those cases, dots may 
represents different perturbations and should be labelled by different numbers, hence the line-dot diagrams mentioned 
above are now extended to sums of all possible permutations with respective topology. All the diagrams must be read 
from right to left to present correct formula. 



V. QUANTUM PHASE DIAGRAMS OF BOSE SYSTEMS IN NON-RECTANGULAR OPTICAL 

LATTICES 

With this line-dot diagrammatic representation of perturbation theory in hand, we now turn to our problem to see 

(n) 

how the arrow diagrams included in can be translated into the above mentioned line-dot diagrams. 

As is known, each a^^^ consists of exactly one creation operator (associated with J), one annihilation operator 
(associated with J*), and n hopping operators (associated with t"). Moreover, since the unperturbed ground state is 
local states, thus all these terms should be treated as different perturbations, i.e., each arrow in the arrow diagram of 
ag"'' corresponds to a dot in the respective line-dot diagram. Then with these dots, for each arrow-line diagram we 
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draw all possible topologically different line-dot diagrams. The sum of these diagrams gives the corresponding result. 
To illustrate this more clearly, let us take SL as an example. This arrow diagram is a part of in triangular 
lattice and Kagome lattice. As discussed above, we label the five arrow lines explicitly as 



Si 



(13) 



These five processes correspond to five distinguishable points in line-dot diagrams. According to the translation rules 
discussed above, this arrow diagram can be reformulated in terms of line-dot diagrams as 



Si 



> > > > 



• > > 



(14) 



Here, we should keep in mind that all these unnumbered line-dot diagram in the equation stand for the sum of all 
possible permutations. According to the line-dot diagram rule, all these diagrams can be calculated. Since here we 
are only concentrated on the properties of ground state, the calculation is relative straightforward. 

t 

u 




FIG. 1: (color online) The phase boundaries of MI-SF quantum phase transition of Bose system in a triangle lattice at T = 0. 
The red solid line is the third-order calculation, the green dashed line is the second-order result, while the blue dot dashed line 
is the first-order (mean-field) result. 



By making use of the technique mentioned above, after a laborious yet straightforward calculation, the third order 
approximation of the phase boundaries int/U-^/U plane for scalar bosons in a triangular lattice with different integer 
filling factors are given by 



3(-3 + /i)(-l + /i)M(-3 - 5/i - TjP ~ 4/i3 + 3^^)U 
' 2(81 + 108/i + 135/i2 + 438/i3 + mAfl^ - 580/1^ + 266fl^ - 36/i7) ' 

(-4 + /i)(-2 + /i)(-l + fi){l + /i)(12 - 129/i + lig/i^ - 37/i^ 



for n = 1 



2(-3056 -I- 13152^^ - 23587/2^ -I- 7926/i 



;,--,3 



13446/i^ - 11688/i^ + 806/2" + 1836/i' - 623/i* + 60/i'') 



for 71 = 2 



t?. = 



(-5 + /2)(-3 + /l)(-2 + /2)/l(1080 - 1781/t + 776/i^ + lAfx 



,-,3 



82/i* -I- lijr)U / 2(^129600 - 72360// + 707001/i^ - 859788/i' 



-f389390/i'* 



13498/i^ - 51903/i'' + 19658/i'^ - 2980/i« + IQSfi') 



for n = 3 



(15) 
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where /i = i^/U . These analytical results are shown in Fig. [l]together with the results for first order and second order 
calculation. 

Our third-order analytical result shows that the tip of the n = 1 Mott lobe phase boundary is located at tc/U = 
0.03406, it has relative deviation of 9.7% from the systematic strong coupling expansion result and 9.4% from 
recent numerical result |22l] . 



t 

u 




0.5 1.0 1.5 2.0 2.5 3.0 fj 



FIG. 2: (color online) The phase boundaries of MI-SF quantum phase transition of Bose system in a hexagonal lattice at T = 0. 
The red solid line is the third-order calculation, the green dashed line is the second-order result, while the blue dot dashed line 
is the first-order (mean-field) result. 

The phase diagram of hexagonal lattice in t/U-fi/U plane has also been calculated out analytically via the same 
method, and the results are presented in Fig. [2j The tip of the first Mott lobe phase boundary of hexagonal system 
is located at tc/U = 0.0787, about 8.8% relatively deviating from the numerical result [23 |. 



t 

u 




0.5 1.0 1.5 2.0 2.5 3.0 



FIG. 3: (color online) The phase diagram of MI-SF quantum phase transition of Bose system in a Kagome lattice at T = 0. 
The red solid line is the third-order calculation, the green dashed line is the second-order result, while the blue dot dashed line 
is the first-order (mean-field) result. 

Kagome-lattice many-body systems, due to their novelty, have attracted much attention in condensed matter 
research in recent decade. Naturally, it is worthy to spend more effort on quantum simulating them via ultra-cold 
atoms in optical Kagome lattices. Fortunately, in recent days, this lattice has been realized in experiment [ll|. Here, 
by making use the field-theory method, we also calculate the quantum phase diagram of scalar bosons in optical 
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Kagome lattice, the corresponding analytical expressions of the phase boundaries for different Mott lobes are 

(-3 + + /i)/i(-6 - 7/i - Ibjl^ - 12/}3 + 8/i^)C/ 



(3) 



72 + 24/7 + 113/i2 + 482/t3 + 203fi* - 620/i5 + 274/4^ - Se/i^ 



for n = 1, 



(16) 



and 



(-4 + /i) (-2 + /i) (- 1 + /i) (1 + /i) (40 - 372/i + 377m2 

-lOl/i^ - 60/7^ + 20/1^) C// ( - 10208 + 39280/1 - 69668/^^ + 24200/~/ 

-41171/i'' - 35302/i^ + 1855/i^ + 5788/i^ - 1904/i^ + 180/i^) for n = 2, 



(17) 



(3) _ 



(-5 + /i)(-3 + fl){-2 + /i)/i(1620 - 2669/i + 1171/2^ + 27/i^ 
-122/i'' + 19/i^) C^/ ( - 194400 - 100440/i + 1027124/2^ - 12 
+551310/i'' - 4016/i^ - 82749/i^ + 30264/i^ - 4519/i^ + 252/2^ 
respectively, where /i = fJ-fU. 



for 71 = 3 



(18) 



VI. SUMMARY 

In summary, with the help of effective potential theory, by treating the hopping term in Bosc-Hubbard model 
and external sources as perturbations, and by conducting the linked cluster perturbation calculation, we investigate 
systematically the Mott-insulator-Superfluid quantum phase transitions for ultracold scalar bosons in triangular and 
hexagonal lattices, the corresponding analytical expressions of phase boundaries in these systems and corresponding 
phase diagrams have been presented. By comparing to recent numerical solutions, we have found that the relative 
deviation of our third-order analytical results is less than 10%. 

Stimulated by the recent experimental result pH in which the Kagome optical lattice was realized first time, we 
have also calculated the MI-SF phase boundary for the scalar Bose system in optical Kagome lattice. Our result may 
serve as a reference object for further studies. Meanwhile, as is known, in the non-rectangular lattice systems, due to 
the nontrivial lattice structures, novel and rich new phases will be exhibited, especially in systems in triangular lattice 
and in Kagome lattice, since in these systems the geometrical frustration is possible under some specific circumstance. 
Our result presented in this paper may act as a starting point for further investigation in this direction. 
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